According to @karpathy, nanochat can now train a GPT-2 grade large language model for about 73 dollars in roughly 3 hours on a single 8x H100 node, setting a concrete cost and time benchmark for compact LLM training (source: @karpathy). According to @karpathy, GPT-2 remains a favored milestone because it represents the first recognizably modern LLM stack, and his update highlights reproducible, low-cost training of GPT-2 grade models on current-generation GPUs (source: @karpathy).